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Abstract. We show that two chosen ensembles of spin states, which are differently 
prepared but are described by the same density matrix in quantum mechanics, do 
not fully share the same measurable characteristics. One characteristic on which they 
differ is shown to be the variance of the spin along a given direction. We conclude 
that the statistical description of an ensemble of states as given by its density matrix, 
although sufficient in many cases, should be considered incomplete, as it does not fully 
describe the measurable characteristics of the ensemble. A discussion a posteriori on 
the problem is provided. 

PACS numbers: 03.65.-w, 03.65. Ca, 05.30.-d, 05.30. Ch 
1. Introduction 

Density matrices are naturally used in quantum mechanics for describing physical 
systems whose quantum states are not equal and to which a single wavefunction cannot 
be therefore assigned. These systems are said to be in a mixed state and are described, 
within the density matrix formalism, by means of an incoherent superposition of pure 
states. By definition, incoherent superposition means that the probability of getting 
a certain experimental result, as a consequence of a measurement on the ensemble, is 
given by taking the average of the results which are obtained for the pure states the 
ensemble is made of, where the weights are the population fractions (or numbers) of 
the pure states. Upon this principle, the density matrix formalism has been introduced 
into quantum mechanics in the late 20 's by Von Neumann, Dirac and Landau, who 
developed and applied it to quantum information theory, statistical thermodynamics 
and wave mechanics [TJ |2j [3] . 

Density matrices have been extensively applied for studying numerous Physics fields. 
Few examples may include quantum phase transitions [I], many-particle systems [5], 
entanglement measures [61 [7] and scattering processes j8]. Thorough reviews of the 
density matrix formalism and its applications can be found in Refs. (9j Dm El [12] . 
The evaluation of density matrices for complex systems may present mathematical 
difficulties. For a harmonic oscillator in a thermostat, for example, the density matrix 



Underlining some limitations of the statistical formalism in quantum mechanics 2 

can be built only by performing a double, both quantum and statistical, average over 
the coherent states. Such a density matrix was successfully derived in 1932 by Bloch 
[13] , who used a rather cumbersome mathematical apparatus, and more recently by 
Avakyan et al. [13], by using Glauber's coherent states [151 HSL which allow a more 
concise derivation. 

In the present contribution, we show that ensembles of states, which are represented 
by the same density operator in quantum mechanics, i.e. by the same density matrix, 
may not fully share the same characteristics to measure. Consequently, we remark that 
the description of an ensemble given by its density operator, or by its density matrix, 
although sufficient in many cases, should be considered incomplete, as it does not fully 
describe the measurable characteristics of the ensemble. 

The paper is structured as follows. In section [2] we define two ensembles of spin states 
which will be used throughout the paper. In section [3] we derive, by using primary 
principles of quantum mechanics and statistics, the expectation value and the variance 
of the spin along a chosen direction for both ensembles. In section SI we briefly recall 
the rudiments of the theory of statistical quantum mechanics and we apply such theory 
to the previously defined ensembles. The expectation value and the variance of the spin 
along the same chosen direction are then calculated once again, for both ensembles, 
by using statistical quantum mechanics. The variances of the spin are found to differ 
from the ones presented before. A discussion a posteriori on the problem is presented 
in section where we show that the obtained discrepancy has to be attributed to the 
inapplicability of the statistical formalism of quantum mechanics to the evaluation of 
the variance. A brief summary is given in section [6j 

2. Ensembles definitions and observables to investigate 

The ensembles we consider are made of non- interacting spin-1/2 particles. To some 
extent, spin-1/2 particles are the most representative particles in quantum mechanics, 
since any measurement of their spin along whichever axis can result in only two possible 
outcomes: either +h/2 or —h/2. 

After having defined any system of coordinate axes, we consider two ensembles of 
particles defined as follows: 

• ensemble A: N particles whose spin states are defined along the x axis, N/2 of 
which are eigenstates of the spin operator S x with eigenvalue +H/2, while the rest 
N/2 are eigenstates of the same operator with eigenvalue —h/2 ; 

• ensemble B: N particles whose spin states are defined along the z axis, N/2 of 
which are eigenstates of the spin operator S z with eigenvalue +h/2, while the rest 
N/2 are eigenstates of the same operator with eigenvalue —h/2. 

Both A and B are totally unpolarized ensembles. In the language of statistical quantum 
mechanics, which will be encountered in section IH they are also said to be in a maximally 
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mixed state. 

We shall focus on deriving, for both ensembles, the expectation value and the variance 
of the spin along the x direction. Both of them are measurable quantities. 
We recall that the expectation value of some discrete variable y distributed according 
to a certain probability function f(y) is defined as [IT] 

i 

where % labels the values that the variable y is allowed to assume. 

The variance of y, which is a measure of how widely y is spread about its mean value, 

is obtained as [17] 

Var(y) = E ((y - E(y)) 2 ) 

(2) 

= E(y 2 ) - (E(y)) 2 . 

Normally, the distribution function f(y) is experimentally measured by performing many 
measurement of the observable y. However, in many cases f(y) can be theoretically 
derived, so that predictions for the expectation value and the variance can be provided. 
If we have some operator O and its discrete spectrum of eigenstates |oj) which satisfy 
the equation 

6 \oi) = Oi \oi) , (3) 

in quantum mechanics it is postulated that the expectation value of the variable o over 
a certain state |/3) can be theoretically obtained by calculating [T8| [T9] 

E(o) = (/3|6|/3) = ^|( 0j |/3)| 2 0j , (4) 

i 

where the identity 

i 

and the normalization equation 

(oi\oj) = Si j (6) 

have been used in the last step of equation (j4|). By comparing equation (@| with equation 
(PQ), we notice that the probability function is evidently given by 

f( 0l ) = \( m\ 2 - (7) 

In the next section, we shall show that, while the expectation values of the spin along 
the x direction coincide for the ensembles A and £>, the variances do not. 
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3. Expectation value and Variance for the ensembles 

In this section, we derive the expectation value and the variance of the spin along 
the x direction for the ensembles of states A and B defined in section [2j We will work 
separately on the two ensembles, without turning to the quantum statistical description. 
For this purpose, we can pragmatically think of using, for example, a Stern and Gerlach 
(SG) apparatus with the magnetic field along the x direction [20]. The SG apparatus 
would measure the spin of each single particle of the ensemble, so that the total spin 
of the ensemble would then be obtained as the sum of all the single particle spin 
measurements. 

Since the present manuscript is theoretically oriented, we will consider the SG apparatus 
as ideal, without any experimental limitation. We will furthermore denote with \S X , ±1) 
and \S Z , ±1) the eigenstates of the operators S x and S z respectively. The corresponding 
eigenvalues are ±h/2 in both cases. 

3.1. Ensemble A 

Due to the characteristics chosen for the ensemble A, the SG apparatus would exactly 
separate the particles flux into two equal parts, or, which is the same, it will measure 
N/2 particles having spin along +x direction and N/2 particles having spin along — x 
direction. The probability of registering the outcome ±^/2, when the spin along x is 
measured on the state \S X , ±1), is in fact certainly 1. 

Consequently, the total spin of the ensemble A, as measured along the x direction, will 
be always 0, in any measurement which is carried out on the ensemble, independently 
of the number of particles contained in A. Since, as already recalled in section [21 the 
variance is a measure of how widely the single measurements are spread about the mean 
value, the variance for the spin measurement on the ensemble A is also vanishing. 
We can summarize what previously stated by writing 



where the subscript A denotes the ensemble on which the expectation value and the 
variance are evaluated. S£ represents our theoretical prediction for the measurement of 
the spin along the x direction on the ensemble A. 

3.2. Ensemble B 

Differently from the ensemble A, each particle of the ensamble B, independently the one 
from the other, has probability one-half of being registered with spin along +x direction 
and one-half of being registered with spin along — x direction. This obvious statement 
can be easily proved by writing the spin states which are defined along the z direction 
as [19] 




(8) 



S z ,±l) 



1 



(15,, +1)± \S X7 -1 



)) 



(9) 



V2 
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and by noticing that the probability of registering the outcome ±h/2, in a measurement 
of the spin along the x axis of the state in equation (Q, can be obtained by using 
equation ([7]): 

\{S X ,±1\S Z ,±1)\ 2 = ±. (10) 

In the light of what said above, the measurement outcomes from the SG apparatus must 
follow the binomial distribution. This means that N/2 particles are expected to be 
measured with spin along +x direction and N/2 particles with spin along — x direction. 
Being a binomial distribution, the variance of these expected particles numbers can 
be easily calculated to be N/4 [T7j. If we adopt the standard deviation (<r = vVar) as 
indeterminacy of the measurement, we may write that the number of particles measured 
with spin equal to +h/2 (as well as the number of particles measured with spin equal 
to —h/2) must be 



^±™. (id 

2 2 v ; 

Consequently, the total spin of the ensemble B along the x direction, as measured by 
the SG apparatus, must be 



The factor "2" which multiplies the standard deviation in equation (fT2|) arises from the 
fact that 'not detecting a particle with spin +H/2' results in 'detecting that particle 
with spin —H/2\ 

Summarizing what obtained for the ensemble B: 



E(S , 2 ,.)b 
Var(S x ) B 




(13) 



where S® represents our theoretical prediction for the measurement of the spin along 
the x direction on the ensemble B. 

We can certainly conclude that the two ensembles A and B are not equal, as they 
show a measurable difference, which is the variance of the spin along the x direction. 
The latter can be naturally measured in experiments by extracting the width of the 
measured spin distribution. 

Since only few solid principles of quantum mechanics and of statistics have been used up 
to now, the above predictions are considered reliable: any measurement is reasonably 
expected to agree with them. 



4. Quantum statistical description 



The overall state of an admixture of particles with different states is formally described 
in statistical quantum mechanics by means of the so-called "density operator". The 
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normalized density operator for an ensemble of states reads [ITJ [T2J [EH] 

P = Y^W i \a i )(a i \ , (14) 

% 

where Wi is the statistical weight of the state |aj), or, more practically, is the fraction 
of particles of the ensemble that share the same pure state |aj). If Wi = d~ij, then the 
ensemble is said to be in the pure state \aj). In any other case, the ensemble is said to 
be in a mixed state. If Wi = Wo, where Wq is constant for all i, the ensemble is said to 
be in a maximally mixed state. 

The density matrix which describes the ensemble, in a given representation is 
obtained as 

p ij = (bi\P\b j ) . (15) 

Since it does not make any substantial difference between describing an ensemble of 
states by means of its density matrix or by means of its density operator, we choose to 
deal, in the following, with density operators. 

The density operator for the ensemble A can be explicitly written by applying the 
definition given in section [2] to equation (fT4j) : 

P A = 0.5 \S X , +l){S Xt +l|+0.5 \S X ,-1) {S x , -1| . (16) 



;i7) 



Similarly, the density operator for the ensemble B reads 

P B = 0.5|S 2 ,+1)(S 2 ,+1|+0.5|S 2 ,-1>(S 2 ,-1| 
= 0.5 l^+l) (5^ +11 + 0.51^, -1X^,-11 , 

where, in the last step, we made use of equation Qj, which link spin states defined along 
the x axis with spin states defined along the z axis |19j . 

By comparing equation (fT6l) with equation (jTTl) . we notice that the density operators 
related to the ensembles A and B are analytically the same. Since the density operator is 
supposed to contain the whole information of the ensemble [HI [12], we should conclude 
that A and B show exactly the same polarization features, i.e. they are identical from 
the point of view of any polarization measurement. However, such a conclusion leads 
to a contradiction. As remarked in section [31 the ensembles A and B show at least 
one measurable difference, which is the Variance of the spin along the x direction. It 
can be easily understood that the reason of this difference lies on the different physical 
characteristics which have been chosen a priori to characterize the two ensembles, i.e. 
on the information concerning the preparation of the ensembles. 

To complete the analysis, we derive, similarly to equations (E]) and (fT3l) . the expectation 
value and the variance that the quantum statistical formalism provides for the ensembles. 
For this purpose, we need first to recall that, in such a formalism, the expectation value 
of some variable o is given by [TT1 fl~2| [19] 

E(o) = Tr[PO] , (18) 

where O is the quantum mechanical operator related to o as in equation ([3]), Tr denotes 
the Trace over any set of quantum states and P is the density operator which describes 
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the ensemble on which the variable o is measured. 

By combining equations (j2J), ffl6l) . (IT7|) and ffl~8]) , we obtain: 

= E(S X ) B = WaSJ = 



V&r(S x ) A 



Vai(S x ) B 
4 



Tr[P A S x ] 
Tr[P A Sl] 



Tr[P A S x 



(19) 



oA qt 



0± 



h 



These results are in decisive contrast with equations (|HJ) and (fT3|) . 

We may now notice that the definition of the normalized density operator in equation 
dHJ) does not account for the number of particles that the ensemble contains. By virtue 
of this, any measurable quantity that depends on such number, like the variance of 
the spin measurement over the ensemble along whichever axis, cannot be adequately 
described by using the normalized density operator. Consequently, we are lead to think 
that the usage of the not normalized density operator for the two ensembles, which reads 

m 



Pa = Pb = ^( \s„ +1) (S z , +1\ + \S Z , -1} (S z , -1| 



N 
~2 

might benefit the calculation, 
get in this case are 

Vax(S x ) A = 



(20) 



Indeed, by using equations (fT8]) and fT20|) . the results we 



x)B 



St 



Vax(S x ) B 
h 

0±- 





h 2 N 



(21) 



N 



which are correct for the ensemble B, as they match equation (fl3|) . but still not correct 
for the ensemble A, as they do not match equation (151) . 

Since the density operators for the ensembles A and B are the same while the correct 
results for the variance of the spin along the x direction are not, it is evidently 
not possible to recover the right description for both ensembles within the quantum 
statistical formalism. 



5. Discussion 



To analyze the discrepancy which has been found in the previous sections, we first start 
by recalling how the density operator is normally introduced into quantum mechanics. 
The leading idea which brings to the formulation of the density operator is the following. 
Given an ensemble x made of N sub-ensembles, where each one of the latter is composed 
by particles which share the same quantum state (i = 1, N), the expectation value 
of a certain variable o over the ensemble must reasonably be a statistical average of the 
expectation values of the same variable over the sub-ensembles [10]. The statistical 



Underlining some limitations of the statistical formalism in quantum mechanics 



8 



weight of each addend will naturally be the particles fraction (for intensive variables) or 
the particle number (for extensive variables) of the sub-ensemble. For any observable o, 
this supposition implies 




E( ) Y EE YWi (Pi\ 6 \Pi) 
' N 

J2 W * IA> (Al )°\ a i) 



X 

n \ (22) 



where O is related to o as in equation (^j, Wj is the fraction or the number of particles 
of the ith sub-ensemble and |aj) are states which form a complete basis in the quantum 
space where are defined. The relation £\ |aj) (oj| = 1 has been used in the last 
step. 

Now, from equation (1221) . if O does not depend on the sub-ensembles' states |/3j), we 
clearly see that what depends on the characteristics of the ensemble is enclosed in 
parentheses. In this case, such quantity can be assigned to be representative for the 
ensemble, similarly to the ket vector for a particle state, and is therefore assigned the 
name 'density operator'. As a consequence of this assignment, equation (1221) becomes 
nothing but the explicit form of equation (1181) . 

In order to apply equation (122j) to the variance and, consequently, to obtain the variance 
over an ensemble of states as an expectation value, we should first find an operator which 
correctly represents the variance in quantum mechanics. For this purpose, we notice that 
the correct value for the variance of the spin along the x direction, over an ensemble of 
N particles whose states are can be obtained as 

Var(^)^ = N (f3\ f \(3) = N (f3\ Op \/3) , (23) 

where the operator Og reads 

O i = (Sx-EiS^X 

v ( v - (24) 

(E(S X )A -2S x E(S x ) i . 



- 4 t- \"K»x>^ 

The operator £, as evident from equation (123|) . is defined such that, by acting on any state 
it becomes the index which identifies the state. The evaluation of the expectation 
value contained in the definition of 0| is then performed over that state. 
We could therefore attempt to associate, in quantum mechanics, the operator 0| to the 
variance of the spin along the x direction. However, the definition of the operator 0|, 
as given in equation (121]) . leads to contradictions. For instance, it follows from equation 
(1211) that the eigenstates of the operator O? would be only the two states \S X , ±1), for 
which the correspondent eigenvalues would be vanishing. Because of this, the operator 
0| would then be equivalent to the null operator in quantum mechanics, though the 
expectation value on 0| would not be vanishing over some states, such as \S Z ,±1) or 
\S y , ±1). This is certainly a nonsense! 
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The problem may be identified in the definition of the operator Ot. The definition of 
the operator 0|, as given in equation flMl) . is certainly atypical as it does not allow the 
action of the operator 0| on a given ket state to be disentangled from the statistical 
evaluation of the variable S x over an ensemble of states \(3). 

In short, we can say that it seems not possible to assign a well defined quantum operator 
to the variance and, consequently, equation fl22l) together with the definition of density 
operator cannot be used to predict the variance for an ensemble of states. This is 
the reason of the wrong prediction that the statistical formalism has provided for the 
variance of the spin along the x direction in section HI 

The above discussion strengthens the fact that the description of ensembles of states as 
given by their density operators should be considered incomplete, as it does not allow the 
description of some statistical measurable quantities of the ensembles, like the variance. 

To conclude, we briefly clarify some issues related to unpolarized ensembles. 
Since the two ensembles considered in this paper are both unpolarized and have been 
shown to behave differently in experiments, our reasoning raises the question as to 
which ensemble to theoretically consider when unpolarized particles or systems are the 
object of experiments. However, as explained above, the expectation value of physical 
observables, for which a quantum operator can be safely assigned, does not change 
when the unpolarized ensemble is changed, but rather it is equally well described by 
any unpolarized ensemble. Since such quantities represent what is normally aimed to 
be measured in experiments, the problem of choosing the right unpolarized ensemble of 
states is without foundation. On the contrary, when a full description of the ensemble 
is required, including observables like the variance, then the choice of the unpolarized 
ensemble to theoretically consider should be constrained by the information concerning 
the preparation of the ensemble. When the experimental preparation of the ensemble is 
not under control, the unpolarized ensemble to theoretically consider should be averaged 
over the possible representations, or, which is effectively the same, the phase which 
determines the used representation should be randomly defined, as pointed out by 
Tolman in the late thirties (21 j . 

In the forthcoming papers, we will further investigate how the theoretical and 
experimental results depend on the preparation of the ensemble. 

6. Summary 

In summary, we have showed that ensembles of states which share the same density 
operator in quantum mechanics, i.e. the same density matrix, can behave differently in 
experiments. In order to prove this statement, we started out by defining two ensembles 
of spin states and by showing, without using any quantum statistical mean, that these 
two ensembles are characterized by a measurable difference, which is the variance of the 
spin along a given direction. Then, we moved to analyze the two ensembles within the 
statistical formalism of quantum mechanics. Since, in this formalism, the two ensembles 
turn out to be identically described, the variance of the spin is found to be equal for both 
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of them. The contradiction is then solved out by showing that the statistical formalism 
of quantum mechanics cannot be applied at all to evaluate the variance of the spin of 
ensembles. We therefore concluded that the description of ensembles given by their 
density operators (or by their density matrices) should be considered incomplete, as it 
cannot be applied to predict some measurable statistical quantities and, furthermore, 
as it lacks for measurable information given by the preparation of the ensembles. 
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